Tootfinder

Iterative Reasoning Preference Optimization
Richard Yuanzhe Pang, Weizhe Yuan, Kyunghyun Cho, He He, Sainbayar Sukhbaatar, Jason Weston
https://arxiv.org/abs/2404.19733 https://arxiv.org/pdf/2404.19733
arXiv:2404.19733v1 Announce Type: new
Abstract: Iterative preference optimization methods have recently been shown to perform well for general instruction tuning tasks, but typically make little improvement on reasoning tasks (Yuan et al., 2024, Chen et al., 2024). In this work we develop an iterative approach that optimizes the preference between competing generated Chain-of-Thought (CoT) candidates by optimizing for winning vs. losing reasoning steps that lead to the correct answer. We train using a modified DPO loss (Rafailov et al., 2023) with an additional negative log-likelihood term, which we find to be crucial. We show reasoning improves across repeated iterations of this scheme. While only relying on examples in the training set, our approach results in increasing accuracy for Llama-2-70B-Chat from 55.6% to 81.6% on GSM8K (and 88.7% with majority voting out of 32 samples), from 12.5% to 20.8% on MATH, and from 77.8% to 86.7% on ARC-Challenge, which outperforms other Llama-2-based models not relying on additionally sourced datasets.

"Low Performer: "Ich täusche Technikprobleme vor, um nicht angerufen zu werden"
Sie gehen joggen, sortieren Leergut, schauen TV – während der Arbeitszeit. Zwölf Menschen erzählen, wie wenig sie wirklich arbeiten. Auch in Führungspositionen."
ich zeige euch wie es geht werdet auch low performer folgt mir auf insta ihr braucht das richtige mindset 📈

Von Russland eingesetzter Gouverneur meldet Tote in Region Saporischschja
Nach Behördenangaben sind bei ukrainischem Beschuss in der von Russland teilweise besetzten Region Saporischschja zwei Menschen getötet worden. Wie der von Russland eingesetzte Statthalter des besetzten Gebiets, Jewgeni Balizkij, auf Telegram schrieb, wurden bei der Attacke in der Ortschaft Pologi zwei weitere Menschen - eine Mutter und ihr Kind - verle…
📑

Ukraine-Liveblog: ++ Generaloberst: Ukrainische Truppen zurückgefallen ++
Laut dem Generaloberst der ukrainischen Armee sind die Truppen an drei Stellungen zurückgefallen. Russische Behörden melden zwei Tote bei ukrainischem Angriff auf besetztes Gebiet Saporischschja. Die Entwicklungen vom Sonntag zum Nachlesen.

Federated Complex Qeury Answering
Qi Hu, Weifeng Jiang, Haoran Li, Zihao Wang, Jiaxin Bai, Qianren Mao, Yangqiu Song, Lixin Fan, Jianxin Li
https://arxiv.org/abs/2402.14609

Federated Complex Qeury Answering
Complex logical query answering is a challenging task in knowledge graphs (KGs) that has been widely studied. The ability to perform complex logical reasoning is essential and supports various graph reasoning-based downstream tasks, such as search engines. Recent approaches are proposed to represent KG entities and logical queries into embedding vectors and find answers to logical queries from the KGs. However, existing proposed methods mainly focus on querying a single KG and cannot be applied…

Focus on Your Question! Interpreting and Mitigating Toxic CoT Problems in Commonsense Reasoning
Jiachun Li, Pengfei Cao, Chenhao Wang, Zhuoran Jin, Yubo Chen, Daojian Zeng, Kang Liu, Jun Zhao
https://arxiv.org/abs/2402.18344

Focus on Your Question! Interpreting and Mitigating Toxic CoT Problems in Commonsense Reasoning
Large language models exhibit high-level commonsense reasoning abilities, especially with enhancement methods like Chain-of-Thought (CoT). However, we find these CoT-like methods lead to a considerable number of originally correct answers turning wrong, which we define as the Toxic CoT problem. To interpret and mitigate this problem, we first utilize attribution tracing and causal tracing methods to probe the internal working mechanism of the LLM during CoT reasoning. Through comparisons, we pr…

Towards Inclusive Video Commenting: Introducing Signmaku for the Deaf and Hard-of-Hearing
Si Chen, Haocong Cheng, Jason Situ, Desir\'ee Kirst, Suzy Su, Saumya Malhotra, Lawrence Angrave, Qi Wang, Yun Huang
https://arxiv.org/abs/2403.17807

Towards Inclusive Video Commenting: Introducing Signmaku for the Deaf and Hard-of-Hearing
Previous research underscored the potential of danmaku--a text-based commenting feature on videos--in engaging hearing audiences. Yet, for many Deaf and hard-of-hearing (DHH) individuals, American Sign Language (ASL) takes precedence over English. To improve inclusivity, we introduce "Signmaku," a new commenting mechanism that uses ASL, serving as a sign language counterpart to danmaku. Through a need-finding study (N=12) and a within-subject experiment (N=20), we evaluated three design styles:…

Can We Help You?
Great Australian Pods Podcast Directory: #GreatAusPods

Can We Help You? | Great Australian Pods Podcast Directory
Podcast: Can We Help You? Hosts: Sacha Barbour Gatt and Jaxson McLennan Category: Comedy Sub-Category: Comedy Interviews & Chats, Self-Improvement & Advice First Episode: 2021 Sach and Jax answer life’…

Bu ara Cold Case seyrediyorum, epey zamandan sonra yeniden. Müzik konusunda çok iyiydi, hala öyle...
https://open.spotify.com/track/2u2udGmop1z67EPpr91km7?si=QrJ2F_RaSO6_ANghrpQx5w

When did “the 80’s” start? 🤔
I like this answer from Reddit 👇
"I see five distinct parts:
80 - 81: Fast Times at Ridgemont High era, rock was popular, New Wave just showing up. J Geils Band, Asia, Billy Squier.
82 - 83: New Romantics era, New Wave becomes more widely accepted. Culture Club, Spandau Ballet, Missing Persons.
84 - 85: Monsters of Pop era. Bruce Springsteen, Prince, Michael Jackson, Madonna, Cindy Lauper.
86 - 87: Stock Aitken Waterman e…

When did “the 80’s” start? 🤔
I like this answer from Reddit 👇
"I see five distinct parts:
80 - 81: Fast Times at Ridgemont High era, rock was popular, New Wave just showing up. J Geils Band, Asia, Billy Squier.
82 - 83: New Romantics era, New Wave becomes more widely accepted. Culture Club, Spandau Ballet, Missing Persons.
84 - 85: Monsters of Pop era. Bruce Springsteen, Prince, Michael Jackson, Madonna, Cindy Lauper.
86 - 87: Stock Aitken Waterman e…